Personnel
Overall Objectives
Research Program
Application Domains
Highlights of the Year
New Software and Platforms
New Results
Bilateral Contracts and Grants with Industry
Partnerships and Cooperations
Dissemination
Bibliography
XML PDF e-pub
PDF e-Pub


Section: New Results

Application of deep learning on healthcare

Participants : Thanh Hung Nguyen, François Brémond.

Healthcare standards have changed dramatically over the past 100 years. People nowadays are aware of the importance of health in their lives. The rising income has enabled them to use private healthcare services. Since the demand is growing rapidly, the physicians need tools which can help them work effeciently in terms of time and cost. Parallely, deep learning has become very popular in the recent years because of its success in computer vision. We have proposed two applications ,VISIONUM and REMINARY, as demonstration of the impact of deep learning on the healthcare.

The first application, VISIONUM (see 9.2.2.1), can detect when the patients lose their focus on the therapeutic exercise and thereby reminds them to return back to the exercise. Since the patients can correct themselves on their own, while they are doing exercises, therapists can focus more on the performance of the exercise. It also helps the therapist to keep track of multiple patients at the same time and hence, save both time and money (see Figure 35).

The second application, REMINARY (see 9.2.2.3), aims to detect the movement of people. In this application, the movement of patients is tracked and analysed. The output gives therapists an overview of the movement of their patients. This information is used by the therapist to monitor the diseases which are related to the movement and decide if there is any improvement due to the treatment. For both applications, we can also analyse emotions like happiness of patient. This information is extremely important for the design of the exercise (see Figure 36 and Figure 37).

Figure 35. Examples of our application VISIONUM, we detect two people in the scene, but only the person in the red bounding box is interested. This person is detected as sitting too far from the camera using depth information, he will be reminded that he should come closer so the exercise can continue.
IMG/visionum.jpg
Figure 36. Examples of our application REMINARY, the actor is doing some exercise. In this case, the event that he raised both his hands is detected. The visualisation make the therapist easier to see how the system catches the event.
IMG/reminary_main.jpg
Figure 37. Examples of the other feature of our application REMINARY. The movement region is highlighted by a green color.
IMG/reminary_dense.jpg